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Description 

SCALABLE VIDEO FORMAT CONVERSION 

SYSTEM 

Background of Invention 
[0001] 1. Field of the Invention 

[0002] The invention relates to a scalable video format conver- 
sion system, and more particularly, to a system which dy- 
namically determines how many video fields are used in 
motion detection process when converting an interlaced 
video signal into a progressive video signal. 

[0003] 2. Description of the Prior Art 

[0004] Generally speaking, there are two kinds of video signal, 

one is progressive video signal, and the other is interlaced 
video signal. In a progressive video signal, a video frame 
comprises all points (or pixels) of the image at any given 
sampling time. In an interlaced video signal, a video field 
comprises only half the pixels of the image at any given 
sampling time, and another video field at the next sam- 



pling time comprises tlie remaining half of the pixels. The 
advantage of interlaced scanning is that a high field rate 
can be achieved. However, when an interlaced video signal 
must be played on a progressive display device (such as a 
computer monitor), the interlaced video signal must be 
converted into a progressive video signal through "inter- 
laced to progressive conversion". 
[0005] Conventional systems use a dedicated video format con- 
version chip to process video format conversion. The cal- 
culation requirements, the memory volume requirements, 
and the memory bandwidth requirements are roughly 
fixed, hence it does not require complex system resources 
management. With the advances of modern computer sys- 
tems, some chips with integrated video processing capa- 
bilities are proposed. System resources management 
therefore becomes more and more complicated. A simple 
solution is to sufficiently design the system for handling 
the strictest situation. However, systems sufficient for 
handling the strictest situation cost much, and the 
strictest situation is not the most regular case. The draw- 
back is that the system resources will not be used effi- 
ciently. 

[0006] In United States patent number 6452639 disclosed by 



Wagner, a de-interlacing metliod for dynamically deter- 
mining which interpolation algorithm being used accord- 
ing to the state of system resources is proposed. With the 
method, when system resources are plentiful, the system 
uses a more complex interpolation algorithm, and when 
system resources are sparse, the system uses a simpler 
interpolation algorithm. 

[0007] However, using the motion-adaptive de-interlacing 

method is the most efficient way to process interlaced to 
progressive conversion. The motion-adaptive de- 
interlacing method generally includes two steps. The first 
step involves processing motion detection, which means 
detecting a motion situation by checking a fix number of 
video fields of the interlaced video signal. Then, the sec- 
ond step involves selecting a proper interpolation algo- 
rithm according to the detected motion situation. 

[0008] Fig.l shows a conventional video format conversion sys- 
tem. In Fig.l, the video format conversion system 100 is a 
single chip containing an MPEG codec circuit 120 and a 
video format conversion circuit 140. The video format 
conversion system 100 utilizes the variable system re- 
sources 180 (including memory bandwidth, memory ca- 
pacity, etc.) to process MPEG encoding/decoding and 



video format conversion. Tlie video format converter 140 
includes a motion detector 150 and an interpolator 160. 
The motion detector 150 determines a motion situation 
by checking a fix number of video fields in an interlaced 
video signal. The interpolator 160 converts the interlaced 
video signal into a progressive video signal with a chosen 
interpolation algorithm, which is chosen according to the 
motion situation. 
[0009] In motion detection process, in actuality, the number of 
utilized video fields does not have to be fixed. Generally, 
the number of utilized video fields ranges from 2 to 6 
fields (or even more than 6 fields). The more fields are 
utilized, the more accurate the detected motion situation 
will be. However, more system resources will be con- 
sumed when more video fields are utilized. Fig. 2 shows an 
example of 3-field motion detection. For determining the 
motion situation of an interpolating point X in field T, the 
3-field motion detection finds the difference between the 
pixel value of point A in field T-1 and the pixel value of 
point B in field T+1, then uses a threshold to distinguish 
the result between static and dynamic. When 




> threshold, the result is dynamic; when 



\A-B 



< threshold, the result is static. The system can select a 
proper interpolation algorithm according to whether the 
result is dynamic or static. 
[0010] Fig. 3 shows an example of 6-field motion detection. The 
point X in field T is the interpolated point. When 




> threshold or 




> threshold or 




> threshold or 




> threshold or 



E-H 

> threshold or 

\A-I\ 

> threshold, the result is dynamic, otherwise the result is 
static. The situation shown in Fig. 3 is only an example. 
The used fields for motion detection process can be from 
T-3 to T+2, from T-2 to T+3, or other successive 6 fields. 

[0011] As mentioned above, when more video fields are utilized 
in motion detection process, the more system resources 
will be consumed. However, in the prior art as shown in 
Fig.l, conventional video format conversion system does 
not determine the number of video fields used in motion 
detection process dynamically according to the availability 
of variable system resources. That is, the system does not 
always use the best motion detection method acceptable 
to the available system resources at any given time. The 
draw back of the above mention situation is that the sys- 
tem resources are not used efficiently. 
Summary of Invention 



2] It is therefore an objective of the present invention to pro 
vide a scalable video format conversion system that can 
dynamically determine the number of video fields used in 
motion detection process according to the situation of 
system resources to solve the above-mentioned prob- 
lems. 

3] According to an embodiment of the present invention, a 
scalable video format conversion system is disclosed. The 
scalable video format conversion system utilizes various 
system resources to convert an interlaced video signal 
into a progressive video signal. The disclosed scalable 
video format conversion system comprises a scalable mo- 
tion-adaptive de-interlacing system and a mode control 
module. The scalable motion-adaptive de-interlacing sys- 
tem converts the interlaced video signal into the progres- 
sive video signal according to a motion situation of an im 
age area. The scalable motion-adaptive de-interlacing 
system comprises a variable-field motion detection appa- 
ratus which accesses a variable number of video fields to 
detect the motion situation of the image area. The num- 
ber of video fields accessed by the variable-field motion 
detection apparatus is determined by a mode control sig- 
nal. The mode-control module generates the mode con- 



trol signal according to tlie availability of the various sys- 
tem resources and/or the status of the scalable video for- 
mat conversion system. 

[0014] It js an advantage of the present invention that the dis- 
closed variable-field motion detection apparatus dynami- 
cally selects a proper detection number according to the 
availability of system resources and the status of the scal- 
able video format conversion system. Hence the system 
resources will be used more efficiently, and better video 
effects can be achieved. 

[0015] These and other objectives of the claimed invention will 

no doubt become obvious to those of ordinary skill in the 

art after reading the following detailed description of the 

preferred embodiment that is illustrated in the various 

figures and drawings. 
Brief Description of Drawings 

[0016] Fig.l shows a block diagram of a conventional video for- 
mat conversion system. 

[0017] Fig. 2 shows an example illustrating 3-field motion detec- 
tion. 

[0018] Fig3 shows an example illustrating 6-field motion detec- 
tion. 

[0019] Fig. 4 shows an embodiment of a scalable video format 



conversion system according to tlie present invention. 

[0020] Fig. 5 sliows a blocl< diagram of the scalable motion- 
adaptive de-interlacing system of Fig. 4. 

[0021] Fig. 6 shows a lookup table for determining the detection 
number according to the available memory bandwidth. 

[0022] Fig. 7 shows a lookup table for determining the detection 
number according to the user-selectable operation mode. 

[0023] Fig. 8 shows a second embodiment of a variable-field mo- 
tion detection apparatus according to the present inven- 
tion. 

[0024] Fig. 9 shows a third embodiment of a variable-field motion 

detection apparatus according to the present invention. 
Detailed Description 

[0025] Fig. 4 shows an embodiment of a scalable video format 
conversion system according to the present invention. In 
this embodiment, the scalable video format conversion 
system 400 is implemented in a single chip 400 having 
both MPEG encoding/decoding capability and video for- 
mat conversion capability. The variable system resources 
480 (such as memory, memory bandwidth, etc.) are 
shared by an MPEG codec circuit 420 and a scalable mo- 
tion-adaptive de-interlacing system 440 of the single chip 
400. When converting an interlaced video signal into a 



progressive video signal, the scalable motion-adaptive 
de-interlacing system 440 accesses a plurality of of video 
fields to determine a motion situation of an image area. 
The number of the plurality of video fields accessed by the 
scalable motion-adaptive de-interlacing system 440 is 
equal to a detection number, and the detection number is 
dynamically determined by a mode control module 410 
according to the availability of the system resources 480 
and/or the status of the scalable video format conversion 
system 400. In the scalable motion-adaptive de- 
interlacing system 440, a variable-field motion detection 
apparatus 450 handles the motion detection process. Af- 
ter the motion situation is determined, an interpolator 
460 chooses a proper interpolating algorithm to convert 
the interlaced video signal into the progressive video sig- 
nal. 

[0026] Fig. 5 shows a block diagram of the scalable motion- 
adaptive de-interlacing system 440. In the embodiment 
shown in Fig. 5, the variable-field motion detection appa- 
ratus 450 includes five motion detectors 455a-e. Each of 
the motion detectors 455a-e implements motion detec- 
tion process with a specific number of video fields. The 
detection number determined by the mode control mod- 



ule 410 will decide which of the motion detectors 455a-e 
will be used. For example, when the detection number de- 
termined by the mode control module 410 is six, the mo- 
tion detector 455e will be used to implement motion de- 
tection process. When the detection number is four, the 
motion detector 455c will be used to implement motion 
detection process. As mention above, the interpolator 460 
selects a proper interpolation algorithm according to the 
motion situation detected by the variable-field motion de- 
tection apparatus 450. Please note that, in this embodi- 
ment, each motion detector 455a-e handles motion de- 
tection process with a specific number of video fields. 
However, it is also possible that the variable-field motion 
detection apparatus 450 handles motion detection pro- 
cess with different numbers of video fields by itself, rather 
than containing five motion detectors. Such apparatus will 
be discussed in more detail later. 
[0027] As mentioned above, the mode control module 410 deter- 
mines the detection number according to the availability 
of the system resources 480 and/or the status of the scal- 
able video format conversion system 400. For example, 
the availability of the system resources 480 can be deter- 
mined according to the computational power of the seal- 



able video format conversion system 400, the available 
space in a memory (not shown) of the system resources 
480, the available memory bandwidth, or the limitation of 
power consumption, etc.. When the availability of the vari- 
able system resources 480 shows that there are abundant 
available system resources, the mode control module 410 
will set the detection number larger; when the availability 
of the variable system resources 480 shows that there are 
only sparse available system resources, the mode control 
module 410 will set the detection number smaller. Taking 
memory bandwidth as example, the table shown in Fig. 6 
is a lookup table for determining the detection number 
according to the available memory bandwidth. It is noted 
that the lookup table shown in Fig. 6 is only illustrative 
and not limiting. 
[0028] Further, the status of the scalable video format conversion 
system 400 can be determined according to the bit rate of 
a video bit-stream or an audio bit-stream, the data pro- 
cessing rate of a video codec or an audio codec, the work 
load of a parser, the display or decoding load of a sub- 
picture controller, the display workload of an on- 
screen-display controller (OSD), or the user-selectable 
operation mode, etc.. When the status of the scalable 



video format conversion system 400 shows tliat tliere are 
still abundant system resources for the scalable motion- 
adaptive de-interlacing system 440 to use, the mode con- 
trol module 410 could set the detection number larger. 
When the status of the scalable video format conversion 
system 400 shows that there are only sparse system re- 
sources left for the scalable motion-adaptive de- 
interlacing system 440 to use, the mode control module 
410 could set the detection number smaller. 

[0029] The above-mentioned "user-selectable operation mode" 
could be a Letterbox mode. Pan-scan mode, PAL-to-NTSC 
conversion mode, NTSC-to-PAL conversion mode, zoom 
in mode or zoom out mode, etc.. Each specific operation 
mode could corresponds to a specific detection number. It 
is also noted that the modes shown in Fig. 7 are only il- 
lustrative and not limiting. 

[0030] In addition to Fig. 4, the mode control module 410 can 
also be implemented inside a memory controller (not 
shown in Fig. 4) of the scalable video format conversion 
system 400, to dynamically adjust the detection number 
according to the bandwidth workload of the memory con- 
troller. When the memory controller has a smaller band- 
width workload, the mode control module could set the 



detection number larger. When the memory controller has 
a larger bandwidth workload, the mode control module 
could set the detection number smaller. 
[0031] As mentioned above, rather than containing five motion 
detectors as shown in the embodiment of Fig. 5, the vari- 
able-field motion detection apparatus 450 could also 
handle motion detection process with different numbers 
of video fields by itself. Fig. 8 shows a second embodiment 
of a variable-field motion detection apparatus 800 ac- 
cording to the present invention. The variable-field mo- 
tion detection apparatus 800 processes motion detection 
process by accessing a plurality of video fields of an inter- 
laced video signal to determine the motion situation of an 
image area. In this embodiment, the variable-field motion 
detection apparatus 800 comprises six pixel difference 
circuits 810a-f, a decision circuit 890, and six multiplex- 
ers 850a-f. As a whole, the multiplexers 850a-f could be 
regarded as a field-number adjuster. Each one of the pixel 
difference circuits 810a-f computes the pixel value differ- 
ence between a point on two different video fields and 
generates a detection value as a result. Referencing the 
example shown in Fig. 3, in this embodiment the inputs of 
the pixel difference circuits 810 a-f are pixel values of 



points A, B, C, D, E, F, G, H, I shown in Fig. 3. Eacli of the 
pixel difference circuits 810a-f contains a subtracter 
820a-f and an absolute value circuit 830a-f, which can be 
used to compute the absolute value of the difference be- 
tween two pixel values. After a detection value of a pixel 
difference circuit passes through a corresponding multi- 
plexer, a corresponding comparator will compare the de- 
tection value with a predetermined threshold, then gener- 
ates a boolean value as a result. Please note that the pre- 
determined thresholds used by the comparators 860a-f 
could have a common value or have different values. A 
logic OR operation is then preformed on these boolean 
values BLa-f to generate the motion detection result. In 
the above mentioned situation, the variable-field motion 
detection apparatus 800 can be regarded as a 6-field mo- 
tion detector. 

[0032] However, 6-field motion detection is not necessary at all 
times. Hence the field-number adjuster can dynamically 
adjust the number of video fields used in motion detec- 
tion process. For example, when 5-field motion detection 
is applied by the system, the value inputted to the com- 
parator 860f will be set to '0' by the multiplexer 850f 
(which is part of the field-number adjuster). In this way. 



the T-3 field in Fig. 3 will have no influence on the motion 
detection result. When 4-field motion detection is applied 
by the system, the values inputted to comparators 860f, 
860e, and 860d will be set to '0' by the multiplexers 850f, 
850e, and 850d (which are all parts of the field-number 
adjuster). In this way, the T-3 and T+2 fields in Fig. 3 will 
have no influence on the motion detection result. Hence, 
it can be seen that by switching the multiplexers 850a-e 
properly, the variable-field motion detection apparatus 
800 could adjusts the number of video fields used in mo- 
tion detection process dynamically. Please note that, set- 
ting the values inputted to the comparators 860a-e to '0' 
by properly switching the multiplexers 850a-f is just an 
example. To adjust the number of video fields used in 
motion detection process, each value inputted to a com- 
parator in Fig. 8 could also be set to any value smaller the 
threshold used by a corresponding comparator. 
[0033] In addition, rather than being located between the pixel 
difference circuits 810a-f and the comparators 860a-f, 
the field-number adjuster (which includes the multiplex- 
ers 850a-f in Fig. 8 in this embodiment) could also be lo- 
cated between the comparators 860a-f and the logic OR 
circuit 870 to set some of the boolean values BLa-f to 



zero; or be located in front of the pixel difference circuits 
810a-f to set some output end pairs to the same value. 
Above are some possible implementations of the field- 
number adjuster. 

[0034] Sometimes motion detection with few number of video 
fields used will not be able to detect fast moving objects. 
In this situation the edges of a fast moving object might 
appear as ragged sawtooths rather than smooth curves. 
To solve this problem, the variable-field motion detection 
apparatus 800 of the present invention can also operate in 
conjunction with a mouse teeth detector (also called a 
sawtooth detector), as shown in Fig. 8, to prevent ragged 
sawtooths from appearing. For more details on sawtooth 
detectors, please refer to U.S. Patent number 5,625,421. 

[0035] Fig. 9 shows a third embodiment of a variable-field motion 
detection apparatus 900 according to the present inven- 
tion. The main difference between the variable-field mo- 
tion detection apparatuses 900 and 800 is that the select 
module 960 of decision circuit 990 selects a largest de- 
tection value output by the pixel difference circuits 
910a-f. The comparator 970 can then compare the largest 
detection value with a predetermined threshold to get the 
final motion detection result. The multiplexers 950a-f, 



which could be regarded as a field adjuster, set some de- 
tection values output by the pixel difference circuits 
910a-f to zero (or another value smaller than the prede- 
termined threshold). Hence dynamically adjusting the 
used field number can be achieved. Please note that, 
rather than being located between the pixel difference cir- 
cuits 910a-f and the select module 960, the field-number 
adjuster (which includes multiplexers 950a-f in this em- 
bodiment) could also be located in front of the pixel dif- 
ference circuits 910a-f to set some input end pairs of 
some pixel difference circuits to the same value. For ex- 
ample, when the detection number is six, the field- 
number adjuster could pass pixel valus on six different 
video fields to the inputs of the pixel difference circuits 
910a-f. When the detection number is five, the field- 
number adjuster could set the two values inputted to the 
pixel difference circuits 910f as the same value, at this 
time only five video fields will affect the motion detection 
result. When the detection number is four, the field- 
number adjuster could set the two values inputted to the 
pixel difference circuits 910f as the same value, set the 
two values inputted to the pixel difference circuits 910e 
as the same value, and set the two values inputted to the 



pixel difference circuits 910d as tlie same value, at this 
time only four video fields will affect the motion detection 
result. Its apparent that through switching the field- 
number adjuster properly, the number of video fields used 
in motion detection process could be adjusted dynami- 
cally, according to the detection number determined by 
the mode control module 410. Furthermore, the variable- 
field motion detection apparatus 900 of this embodiment 
can also operate in conjunction with a mouse teeth detec- 
tor as mentioned before. 
[0036] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, that above disclosure should be construed as lim- 
ited only by the metes and bounds of the appended 
claims. 



